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ABSTRACT 

Tasks for two coordinated industrial robots always bring the robots in contact with a same object. 
The motion coordination among the robots and the object must be maintained all the time. To plan the 
coordinated tasks, only one robot's motion is planned according to the required motion of the object. The 
motion of the second robot is to follow the first one as specified by a set of holonomle equality 
constraints at every time instant. If any modification of the object's motion is needed in real-time, 
only the first robot’s motion has to be modified accordingly in real-time. The modification for the 
second robot is done implicitly through the constraint conditions. Thus the operation is simplified. 

If the object is physically removed, the second robot still continually follows the first one through 
tne constraint conditions. If the first robot is maneuvered through either the teach pendant or the 
keyboard, the second one moves accordingly to form the teleoperation which is linked through the software 
programming. Obviously, the second robot needs not to duplicate the first robot’s motion. The 
programming of the constraints specifies their relative motions. 


1. INTRODUCTION 

The motivation of using two coordinating robots to perform industrial tasks is to Increase the 
overall productivity of the manufacturing process as compared to individual robot work without 
coordination capabilities. \The use of the constraint conditions in the 3tudy of motion-coordination 13 
introduced by Mason [1]. The co’tjstraint concept Is extended and used in our earlier work [2,33 to plan 
coordinated motions of two robots in handling three different types of objects, two of them having their 
own degrees of freedom. In that study, the concept of holonomle constraints, which i3 applied to a system 
of rigid body dynamics by Wittenburvg [H] and extended by us to robots with closed kinematic chain 
mechanisms [53, Is adopted in the analysis. These constraints on the positions and orientations of the 
two robots mu 3 t be satisfied at every time Instant during the period of coordinated motion. To eliminate 
motion errors between them, one of them is assigned to carry the major part of the task. Its motion is 
planned accordingly. The motion of the second robot is to follow that of the first robot as specified by 
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the relations of the Joint velocities derived from the constraint conditions. Thus if any eodif ication of 
the motion is needed in real-time, only the ration of the first robot is aodified. The codification for 
the second robot is done implicitly through the constraint conditions. Specifically, when the joint 
displacements, velocities, accelerations of the first robot are known for the planned or radlfled aotlon, 
the corresponding variables for the second robot can be determined through the constrained relations. 

Mow, if the object is physically reraved, the second robot still follows the first robot continually 
according as the specified equality constraints. In fact, the desired task determines the ration of the 
object and the motion of the first robot, which in turn specify the holonomic constraints between the 
robots. Once the constraints are programmed Into the control computer to guide the motion of the second 
robot, this robot will follow the first one to satisfy the constraints even if the object is physically 
absent. Thus the second robot is maneuvered by the ration of the first robot through the control computer 
according to the programmed constraint conditions between them. If the object is Ignored to begin with 
and the original holonomic equality constraints are replaced by a set of new constraint conditions that 
specifies the teleoperation relations between the two robots, then the realization of the programmable 
teleoperatton is possible. 

In the following, the coordination of two industrial robots handling an object is summarized and the 
experiments of the coordination are described. Their extension to the programmable teleoperation between 
the robots is then presented. 

2. COORDINATION OF TWO INDUSTRIAL ROBOTS 

Using Denavlt-Hartenberg convention [6], each of the (n*l) links of a robot is assigned a coordinate 

system ( ) f° p 1*0,1 n, from the base link to the end-ef factor . The generalized coordinate, 

q^, is the Joint displacement of the link 1 either rotating about or sliding along zj-i with reference to 
Xi_j. Also let A^l.i be the 4 by 4 homogeneous transformation matrix which transforms a vector with 
reference to coordinates (£i.£i»£i) to the same vector with reference to coordinates (*i-i »£ 1-1 »£i-1 )• 
Then 


K (a) = Aofai&ftqj) • • • 4T-i(<u) < i ) 

q n , can be represented by 

( 2 ) 

in which n(^} ,s(£) ,a(£) are unit vectors of coordinates, respectively, x^j, and z,, with reference to 
base coordinates; and £(3) is the position vector with reference to base coordinates, from ifs origin to 
the origin of (x n ,£ n ,z n }. The orientation of the end-effector Is specified by the upper-left 3*3 
submatrix of A 0 n {£) : 


where £ is an n-dlraensional vector consisting of n Joint displacements qi,q2, 
a coordinate frame 


Ao(a) = 


|n(a) 4a) «(a) c(a) 
0 0 0 1 


326 





( 3 ) 


which is also a rotation natrix. Tha Jacobian Matrix Xal’tIfaM.W , whara ( ) T «transpose of () , 
ralatas tha llnaar and angular velocities of tha end-effector with rafaranca to basa coordinators, v and u 


respectively, to g according to 

a«*= y 


( 4 ) 


which leads to 


J,(a)a " it/ 


(5) 


Three cases Involving different types of objects are Investigated In [2]. Tha results are summarized as 
follows: 

Case 1 ♦ Two Robots Handling a Rigid-Body Object 

Consider two robots each with n Joints handling a rigid-body object , which Is large and beyond tha 
carrying capacity of one single robot. In order to Move tha object fro« one point to another, two robot 
end-effectors oust grasp It at two specified points. It Is assumed that tha end-effectors furnish tight 
grips so that there are no relative motions among tha end-effectors and the object. 

For the purpose of convenience, one of the robots Is named the leader and the other tha follower. 

Let and (li.li.li) be the coordinate frames of end-effectors of, respectively, tha leadar. 

and the follower. Let r 1 be the vector with reference to (xitXitli) , from Its origin to tha origin of 
(xj.yj.ljKFlg. 1). Then the holononlc constraints for the positions between the two robots are 




( 6 ) 



Follower 


Figure 1. Two Robots Handling a Rigid-Body Object. 


« 
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while the holonomie constraints for the orientations are 




where and g f are, respectively, the n-dlmenslonal vectors of Joint displacements of the leader and the 
follower; and V is i 3 by 3 constant matrix and the values of its elements depend on the relative 
orientations between the two end-effectors. For the case of n-6, the constraint conditions relate the 
Joint velocities of the follower to that of the leader ast 


a'-f'lal 


Wa*)+; 

Usl 


Iwa'll" 
= [W)] 


UV)=«BUti/)tW 


Case 2 . Two Robots Handling a Pair of Piers 

Refer to Figure 2 and let Oi be a point on the axis of plier's pivot between the two pieces. This axis Is 
parallel to J* and Let r 2 and r3 be, respectively, the vector with reference to IxhhS) from its 
origin to 0; , and the vector with reference to from its origin to Oi . Then, as indicated ia 
Figure 2, the holonomic constraints for the position for this case are 


rta*) + asW-Wifl + Rs(aVl = Q 


Lsader 


Follower 



Figure 2. Two Robots Handling a Pair of Pliers. 


The holonoaic constraints for the orientation, however, reduce to 

t T (d)Us[) = o (12 ) 

t W)a(a f ) = i 

since the normal vectors of the two end-effectors are always parallel to each other. For the particular 
geometry as shown in Fig. 2, an equation which relates the axis of the pivot, Z&, to oan be 

written as 

Jig = 0 (13) 

This is also a constraint if one requires to hold the pliers without slippage. Let q d be the angular 
displacement of the pivot joint of the object. The constraint conditions among the Joint velocities of 
the two robots and the objects are, for the case of n-6, 

- Jr “b 0 0 (14) 


where 


J,(a*) = 

Ua') = 


.(a'l + LV) 
U<t) 

^sl + LV) 
Us!) 


LV) = Wrf) 


(15) 

( 16 ) 
(17) 


and 


LW) = df&HM/dJ 


(18) 


Thus, except at the singulari y point of the follower, a f can be computed rrora (i 1 *) if & and q d are 
given. 

If $ d is not specified, may have infinitely many solutions. However, the minimum norm solution 
which corresponds to the minimum energy solution [7] i3: 


where 


a' = JTM'Wiy 


(19) 


M* = 


L j__fl J 
• n T (af) 
a ; * T (af) 


( 20 ) 
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and 


t* = W*i(a')l T (M , Wa')IU’J(tf)l T }' 1 (20a) 

ia the Moore-Penrose generalized inverse of <M*«S f»C83 . Onoe the minimum norm solution of is 
deteralned, the expected resulting oan be obtained from Cl 1 *) and (19) as 

<U = fo o # » T tf)l Itt- ^ I (21) 

Case 3 . Two Robots Handling an Object Having a Spherical Joint 
Suppose that two robots handle an object consisting of two parts Joined together by a spherical Joint 
(Fig. 3). It is known that the spherical Joint has three degrees of freedom. If the three degrees of 
freedom are specified by a velocity vector of the spherical Joint, then £ f has the same form as (14) 

except that q a .T (it ) „ „„„ replaced Ky = (Wrf faCrf )«Ca , )]oi> T . If. however, they are not 

specified, then there will be only three independent constraint equations associated with two coordinated 
robots C5 3. As indicated in Figure 3. the coordinate and distance vectors are defined in a same manner as 
those in Case 2. When the holonomic constraints for the positions are imposed, the Joint velocities of 
the two robots are related according to 

iV-i* a r = fl < 22 > 


Leader 



r*-"r2 


Follower 


/■*» 


Figure 3. Two Robot* Handling an Objact Having a Spherical Joint. 
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where 


i* = !W) +UVH (23) 

and 

e = Ut(a1 + UV)1 (20 

The holonomlc constraints for the orientation do not apply in this oaae. Thus, unless a three dimensional 
Joint velocity of the object, which has three degrees of freedom in this ease, is specified, equation (22) 
is the only constraint. Since j3 is a 3 by n (ntf) matrix, no unique solution for i f in terms of 
possible. However, the minimum norm solution may be computed as 

a' = < 25> 

where 


r = otwi * 1 (26) 

is the Moore-Penrose generalized inverse of J.3 [3]. Since R 0 n (a*} « orthonoraal matrix, then the 
expected resulting £$ corresponding to the minimum norm solution of £ f may be obtained from (25) and the 
lodified (14) as described above: 


& = ■Ms'll* I’ls'l (27) 

3. EXPERIMENTS OF MOTION COORDINATICW OF TWO ROBOTS 

Two experiments of coordinating two industrial robots corresponding to Cases 1 and 2 have been 
performed in the Robotics and Automation Laboratory of Clemson University. The first one involves 
handling a pail of water using two PUMA-560 industrial robots (Figure 4). Physically the two robots pick 
up the pail and change its orientation. Then they tilt the pail and pour the water into a bucket with a 
small opening. At the beginning, the two robots execute the point-wise coordination. Each robot's 
end-effector moves from its home location to the assigned handle of the pall. For this part of the 
coordinated-motion, the two coordinating local tasks are programmed through VAL-II language, and th*y 
reside in each of the two LSI-11 computers. The synchronization local task is programmed in the VAL-II 

command language and resides in DEC VAX— 11/750 computer. 

As soon as both end-effectors grasp the handles, the trajectory-wise coordination starts. The 
coordinating local task is programmed through C language, which resides in the VAX-11/750. The control 
flow goes through the following steps: 
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Figure 4. Handling a Rigid Object. 

1. The Cartesian trajectory of the leader robot is programmed in the form of a string of 
set points in Cartesian coordinates according to the desired trajectory of the pail. 

2. The Cartesian trajectory of the follower robot, in the form of a string of set points, 

Is computed from the leader trajectory and the constrained equation, namely the coordi- 
nation algorithm. 

3. Let n-1. 

4. Call Trajectory Planning process to convert the nth set point from the Cartesian coor- 
dinates to the Joint coordinates for both leader and follower robots. In this step, 
the inverse kinematics of robot motion is involved. 

5. Trajectory Planning process calls the Interprocessor Communication primitive to send the 
set points (in Joint coordinates) to the Trajectory Execution processes. 

6. Check if the last set point ha3 been sent. If yes, stop; otherwise, let 
n«n+l and go to step 4. 

After the water is poured into the bucket and the pail is moved back to its original position, the 
point-wise coordination takes over again, and the two robots go back to their home positions. 

The second experiment involves the two robots holding a pair of scissors and cutting a sheet of paper 
in the air (Fig. 5). The procedure is same as that of the first experiment except that the scissors have 
one degree of freedom of their own so that the constraint equation and hence the programming in C are more 
complicated. The detailed descriptions of the two experiments and the control computer structure are 
given in [9]. 

Other experiments of tightly fitted peg insertion, threading a nut onto a bolt, etc., are in progress. 
These experiments require force/torque compliances. A force/torque sensing wrist is mounted on the 
robot-follower which is force controlled. The robot-leader is then purely position controlled. As soon 
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as the robots sake an indirect contact physically, the force/torque feedback signals oust be computed and 
processed through VAX 11/750, This additional burden of computation is significant which tends to 
decrease the band width and the sampling frequency. To speed up the computation, a floating point array 
accelerator is being mounted onto VAX 11/750. However, the experiments are still in progress. 


Figure 5. Handling an Object with One Degree of Freedom 
( A Pair of Scisaora ) 


4. PROGRAMMABLE TELEOPERATION 

In all the experiments described above, if the object(s) is(are) removed, the two robots will go 
through the same motion as if the object(s) were there. The motion of the leader is driven by the stored 
programming in VAX 11/750 while the follower is maneuvered through the programmed constraint conditions. 
If the leader is maneuvered through either the teach pendant or the keyboard, the follower's motion is 
still guided by the constraint conditions. In general, the constraint conditions may be written as 

i f » l)“£ (28) 

where _x is the force/tcrque signal measured by the sensing wrist. 

It is seen that the processes of coordinated motion of two robots can be naturally extended to the 
teleoperation of the two robots provided the teleoperational tasks can be represented by equation (28) for 
every time instant and programmed in the control computer. In fact, the representation by equation (28) 
is not necessarily required so long as the tasks can be described sequentially and programmed accurately. 
Once the software programming i3 available in the control computer, the robot-follower may be teleoperated 
by the robot-leader whenever the latter is maneuvered through either the teach pendant or the keyboard. 

5. SUMMARY 

Coordinated motions of two industrial robots in handling an object, which may have its own degrees of 
freedom, can be achieved by employing the holonomic constraint conditions between the two robots at every 
time instant. The coordination is demonstrated with two PUMA-560 industrial robots controlled by a 
DEC VAX-11/750 computer. The notion coordination is then extended to the process of teleoperation between 
the two robots when the role of holonomic constraint conditions is replaced by the teleoperational tasks 
which are programmed in the control computer. 
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